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For the last few years, the staff at the Far West Laboratory has been engaged 
In the design of educational toys and accompanying learning episodes or "games." 

The latter consist of a series of problems or experiences which best utilize the 
educational potential of the toys. Although the toys and episodes are designed 
to fit Into a variety of educational settings, we are presently concerned with 
their Impact within the toy-lending component of the Parent/Child Course. 

Sped f leal ly , this paper reports the effect of these toys on the cognitive develop- 
ment of children whose parents have participated In the Parent/Child Course. 

Briefly, the Parent/Child Course represents an effort to provide preschool 
experience for three-. to' fourtyesr.dld children ef . parents who carnot-Sf ford to 
send their children to a traditional nursery school and earn too much to send 
their children to Head Start. Parents meet In a classroom setting two hours a 
week for ten weeks with a member of the Laboratory staff or someone trained by 
the Laboratory. 

Sessions consist of films, discussions and written materials focusing on a 
variety of general child development topics. A portion of each session is devoted 
to a discussion of the specific problems and observations generated by the inter- 
actions between a parent add her child. Such discussions are directed by the staff 
member In order to provide informatlc.i which will enhance the parent-child relationship. 

Another major component of the program is the use of educational toys designed 
to facilitate the child's cognitive and personal development. During each weeb'y 
session, parents are give) demonstrations and role-playing experience in the use of 

the specific toys and accompanying episodes they will play with their children that 
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Parents are encouraged to ask their chMd to play with the toy at l«ost 

i 

once a day for 20 minutes. If, on a given day, the child refuses the Invita- 
tion to play, parents are advised not to force the Issue but to try again on 
the following day. On the other hand, If at any time, the child asks to pley 
with the toy, the parent Is Instructed to accomodate him. 

DESIGN OF EVALUATION 

Although the Parent/Chl Id Course is designed to help the child In all areas 
of personal growth, we are presently concerned with the extent to which the 
Course cqn facilitate the child's Intellectual growth. We wish to see whether 
the children Involved In the Course have acquired certain target skills and concepts 
which they did not have before their experience In the toy-lending program ar.d 
which the toys In the Course aee designed to teach. 

To answer this question, we employed a fairly straight-forward single group 
design with replication. First we prertestdd’ two, groups of -thl Idren ■ from the 
same geographical area. After the parents of each group of children had paitlclpated 
In a separate Parent/Child Course, we posttested each group. We then compared the 
two sets of test results to see If the children Involved In the Course had improved 
thel' scores on the I terns relevant to concepts taught by the toys they had played 
with. 

A design of this type Is often criticized, albeit sometimes tenuously, because 
it falls to control adequately for changes brought about by factors other than 
those specifically related to the treatment experience belna evaluated. Educational 
experiences, however, can never be completely Isolated from the everyday Interaetlon 
between the child and his environment. Concepts and skills partially acquired 
within a formal educational setting may become functional In the everyday experiences 
of the child, while those tentatively acquired In dally activities may be strengthened 
by formal educational experiences. Hence, the only entirely accurate way to assure 
that changes In behavior are due just to specific experiences Is to Isolate the 
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child from all other conceivably relevant experiences. To do so when dealing 
with cognitive development Is both practically Imposs 1 b 1 e — a child can have 
cognitive experiences in the most barren of settings--and ethically repugnant. 

The pre-test - posttest control group design with randomization, In which an 
experimental group is given training which a control group Is denied, is an 
attempt to account for the problems In a test- treatment- retest situation. If 
only the experimental group changes In the ways the training (^designed to produce 
we can attribute the changes to the training. If, on the other hand, the control 
subjects show the same changes, then the effects of the training are negligible. 

Yet In many situations, and this Is one of them, the cont|ol group design 

♦ / 

Is not appropriate- The question here is whether reliable changes are effected 
in children whose parents have participated In the Course. Such parents are 
automatically distinguished from a randomly selected control group of parents in 
comparable social groups: they are motivated enough to facilitate their child's 

development to participate in the Course. To have true control group design, 
therefore, we would have to give the Course lo a randomly selected group of 
parents; this Is Impossible since we cannot expect unmot I vated people to participate 
meaningfully In such a lengthy and taxing procedure. Another approach would be to 
identify two groups of similarly we 1 1 -mot I vated parents and deprive one of them 
of the toy-lending component; such a procedure would obviously be ethically 
questionable. 

Still, we must refine our design to make fairly reliable statements on our 
findings. And we must account somewhat for the effect of factors not related to 
the Course, Including the possibility that the children's natural maturation over 
the period between pre- and posttesting accounts for score changes. 

We believe that our design Is adequate in both respects. That two separate 
groups of children were tested adds a replication factor to the basic design; 
parallel changes In the two groups would allow us to assert that score changes 
between the pre- and posttest ere reliable and would give us more confidence that 




changes were due to the Course Itself rather than to Idiosyncratic experiences 
of each child or group of children. Including Items In the assessment Instrument 
unrelated to skills taught by the toys in the Course provides a check of the 
maturation factor. If the changes In scores from pre- to posttest was primarily 
the result of maturation and the consequent Improved ability to assimilate new 
concepts from everyday experiences, we would expect that scores would change 
similarly In Items both related and unrelated to course content. Moreover, If the 
major variable accounting for score changes were learning to take the test itself, 
then children would Improve on all Items, including those unrelated to the Course. 

METHOD OF TESTING 

A. Test SI tes : During the first three months of 1970, Parent/Child Courses were 

held In two separate school districts in metropolitan Salt Lake City. One of these 
was the Jordan School District; there, classes comprised of lower-income parents 
were held at the Midvale School. The second test site was in the Murray School 
District, at the McMillan School. Participants in these classes were middle- to 
high-income families. 

In both districts, classes consisted of small groups of three to four parents 
who met once a week for ten weeks. All courses were taught by Mrs. Peterson, who 
was trained by the Laboratory tc. conduct Parent/Child Courses. 

6. The Responsive fest: To mensure change In the children's Intellectual development, 

the Responsive Test was administered to children of all parents In the Parent/Chlld 

Course. The Responsive Test was especially developed for the assessment of intellectual 

I 

development In children who have particiapted In a Responsive Environment. After 
an extensive review of existing tests, it was decided that no single instrument 
was completely acceptable for assessment of achievement of children In the Responsive 
Model. The Responsive Test was developed to fill this need. Soffn of the items were 
selected from existing batteries. For example, test I terns dealing with letter 

r 
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recognition were adapted from the Metropolitan Reading Readiness Test , and 
other items dealing with color and shape were adapted from the School Mathematics 

S tudy Group . Other items were especially designed for use In the Instrument. 

The final Instrument used In the Salt Lake City testing consisted of 
thirteen subtests dealing with the following areas: 

1. Color Hatching. The child Is asked to match each of nine different 

color cards with one of a series of samp I e cards. 

2. Color Naming. The child is asked to give the color name of each of the 
nine specific color cards. 

3. Color Identification. The child is asked to select one of' the nine- 
colors as the relevant color is named by the tester. 

i) , Shape Hatching. (Same as color matchlng--using four shapes.) 

5. Shape Naming. (Same as color naming--us ing four shapes.) 

6. Shape Identification . (Same as color ident i f i cat ion--us i ng four shapes.) 

7. Letter Recogni tion. The first part requires the child to point to a 
specific letter In an array of five letters. The second part requires 
the child to select from a number o f letters the one which begins a 
word verbally offered by the tester, for example, the child is asked 
to "point to the first letter in the word NO." 

8. Numerical Concepts. This subtest first requires the child to identify 
and write numerals and to count. The harder items require manipulation 
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ol simple numerical concepts, for example, the child is asked to "Add 
the right number of blocks to your row to give It the same number of 
blocks as this row." 

9. Relational Concents. Here the child must recognize the relational words 
such as "longer," "beneath," "middle," etc., and to choose from among 
several pictures the one which best illustrates the concept. 
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10. Sensory Concepts . These items assess the child's knowledge of words 
describing tactile, auditory, and taste sensations as illustrated by 
appropriate pictures. 

11. Problem Solving. This subtest requires that the child recognize 
similarities and differences in color, shape, and size and that he use 
these discrimination skills to extend patterns. 

12. Verbal Communication. The child is presented each of four objects and 
asked to "tell me about this." One point is scored for every bit of 
Information he can relate regarding each object within sixty seconds. 
Points are also given for the use of complete sentences. 

13- Verbal Comprehension. This subtest assesses the child's ability to 
derive meaning from verbally presented material. The child may either 
nod or shake his head, or make verbal responses to such questions as: 
"Do shoes eat?", "Do brooms sweep?", etc. 

While many achievement tests yield a total score, this is not true of the 
Responsive Test. Separate scores are reported for each of the sjbtests. The 
test is individually administered and tikes from thirty to forty minutes to 
complete. 



C. Test i ng Procedures : A few days before the Course actua'ly begins, parants in 

both districts were asked to bring their children to their respective meeting places. 
Mrs. Peterson, who had been trained in the admin! stra* ion cf the Responsive Test, 
individually tested the children In both districts. In the week before the courses 
began, 16 children were pre-tetted In the Hure«y District and 35' In. the'dorden 
District. Posttests were administered at the end of the course to as many of these 
children as possible. All children were posttested ten weeks after pre-testing. 



RESULTS 



Pre-test results were used to obtain an Index of test reliability. A split- 

half (odd-even) reliability coefficient of .96 (correc.ed using the Spearman Brcnm 

O 

»ula) was obtained on the pre-test results of 31 children. 
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Next, test results were summarized for each group and for each subtest. Of the 
31 children that began the program, complete pre- and posttest scores were available 
for only 12 Murray and 7 Jordan children. 

The summary data are reported by subtests in Table I for the Murray group and 
in Table II for the Jordan group. In both tables, the range, average score, and 
variance are reported for pre- and posttest data. In addition, the total number of 
possible points for the subtest, a correlation between the child's pre-test and 
posttest score and a t statistic reflecting the change, with an indication of its 
significance, are also shown. The t statistic is the one calculated for repeated 
measures, and significance has been indicated at the .10, .05, and .01 levels for 
a one-tailed test with 11 and 6 degrees of freedom respectively for the Murray and 
Jordan groups. 

Figures I and 2 were constructed to depict the data graphically. Figure 1 
shows the range of scores for each subtest on pre- and post- Course administrations 
to the Murray group. For each subtest, the broad lines indicate the middle 671 
of the test scores, the upper and lower two scores having been removed. 

Similarly, Figure 2 shows the test score distribution of the Jordan children. 
Here, the broad lines indicate for each subtest the limited range of five children, 
the highest and lowest scores having been removed. 

As Indicated In Table I and shown in Figure 1, the Murray children scored 
high on the pre-test on both the Color Naming and Shape Naming subtests. Because 
of the high initial scores and limited variability of these scores, change was 
negligible and test of significance were not determined for these two subtests. 

Table II and Figure 2 indicate that the Jordan children also found the two sub- 
tests easy on the pre-test and that consequently there was again little change 
2 

on them. 

r~ 

The Responsive Test has been revised and now is more challenging in these 
two areas: It Includes 12 colors and l*i different shapes. 
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SUMMARY PRE- AND POST RESPONSIVE TEST DATA WITH INDICATIONS 



OF CHANGES FOR 12 MURRAY CHILDREN 



SUBTEST 


Total 

Possible 


PRETEST 
Range Mean 


1 

! 

i 

Var. 


r 

1 

POSTTEST 
Range Mean 


tar. 


r 


t 


SA*. 

Level 


Color Matching 


9 


6-9. 


8_ 


_ 2 


- 1 


,1 


0 








Color Naming 


9 


0 - 9 


4 


13 


R 

: o] 
1 


__6 


8 


__*67. 


2J8 


.05 


Color Ident. 


9 


0 - 9 


t, 


J 3 


,4, -JJ 


_ 7_ 


4 


.92 


3. 56 


_.Ji 


Shape Match. 


4 


1 - 4 


4 


1 


* » 


_ J_ 










Shape Naming 


4 


0 - 4 


.J. 


_? 


1 -_4 


3 


1 


.20 


3.36 


.01 


Shape Ident. 


4 J 


0 - 4 


2 


i 3 




4 


_ J _ 




2._76 


.01 


Letter Retog. 


32 


0 - 20 


5 


_44 


0 - 20 


5_ 


47 


jo 


0.31 




Nin. Concept 


25 -- 


0 

1 

r\> 


9J 


72 


2 ,-25, 


J6_ 


51 


, .79. 


4_J7 


.01 


Relat. Concept 


24 


4 - 22 


15 


39 


10 - 22 


_J9, 


13 


.86 


1-81 


.01 


Sensory Concept 


24 


8 - 24 


18 


25 


8 - ?4_ 


.I'L 


.33.... 


.26 


0,12 




Prob. Solve. 


40 


0 - 23 


9_ 


42 


4 - 31 




68 


..50 


3.05 


.01 


Verb. Com. 


• . 


7 - 47 


.18 


145, 


.13 - 57 


30 


227 


.46 


2.83 


.01 


Verb. Compre. 


24 


3 - 23 


.15 


51 


24. 


tiT 




.64 


2.31 
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SUMMARY PRE- AND POST RESPONSIVE UST OATA WITH INDICATIONS 



OF CHANGES FOR 7 JORDAN CHILDREN 



SUBTEST 


Total 

Possible 


PRETEST 
Range Mean 




_Vat ; 


POSTTEST 
Rang" Mean 


r i 

_Var< 


r — 

r 


t 


— > 
4*0 0> 
-J 


Color Matching 


9 


• » 


1 J 


I 0 , 


JLiJL 


J . 


. p.. 


.18 


* « 


- A » 


Color Naming 


9 


0 - 9 


J 


Lyu 


3. - 9 


7 


, 6 


.48 


2.73 


.01 


Color Ident. 


9 


2 * 9 


6 


JO,., 


__6_ 9 


8 


. J . . 


.66 


2.54 


.01 


Shape Matching 


4 


* « 





__0, 




4 


0 


A » 


*- m 


• • 


Shape Naming 


4 


P * 3 


J__. 


1_„ 


1 - 4 


3 


.2 


.42 


4.49 


,ol 


Shape Ident. 


4 


2 - 4 


3 , 




2,-4 


4 


0 


•A?. 


?J_7 


.05, 


Letter Recog. 


32 


0 *12 


5 


13 


i .iJA. 


JL- 


37 


•30 


±d? 




Nun. Concept 


25 


0 -22 


9 


5,7 . . 


T 

3 -25 


17 


82 


. 8 ? 


4.29 


.01 


Relat. Concept 


24 


2 *. 15 - 


JZ 


22 


16 -24 


20 


8 


.87 


4.29 


. 01 , 


Sensory Concept 


24 


10,-24 


JJ 


21 


16 *24 


20 


.17 


.22 


0.39 




Problem Solve. 


40 


2 -16 


10 


JL— 


0 -28 


17 


UP 


.80 


2*59 


•01 „ 


Verb. Com. 


* * 


? -40 


18 


JJ0._ 


14 -40 


35 


2*2 


.20 


2.51 


•01 . 


'erb. Compre. 


24 


2 -22 


16 | 


60 


15 *24 


21 


. 8 


.86 


2. .12 


. 05 , 
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ms i mu s. sig. _L£vt 

A Pre Post 

•Color Matching 8.1 9.0 




iwtColor Naming 4.4 6.5 .05 



Color Identifying 5.3 7.5 .01 



AShepe Matching 3.6 4.0 









1.2 












■ Shape 


9 n 



1.2 2.9 .01 



3.7 .01 




AO 



30 



letters-- 

Rocognltlon 



4.8 5.4 N.S. 



« ■» . IO 13 JIC At 

!■!! !■ I A 



Concepts- 

Numbers 



8.5 16.0 .01 



“ * " 



Concepts-- 

Relational 



14.7 18.9 .01 



.oncepts-- 
ammmmmf '/Sensory ‘ 




18.0 18.2 



.u- 



*> 






Problem Solving 8.7 15.7 .01 



O 1 1> Jd jo 4 ^ 3? 



i 



IA . if 

mmAmm 



Verbal 

— Conwml cation 


18.2 


30.3 


.01 


*4 








» Verbal 
Comprehension 


15.2 


19.2 


.05 



figure I. Range and Means for Pre- and Posttest Responsive Test Scores for IZ.Mufyiy 
children. Blocked In area represents middle 67:1 of children's scores. 
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SUBTEST 




o 




/ j 3 



* 



Color Matching 
Color Naming 

Color Identifying 



i 

AShape Matching 



Shape Naming 



MEAHS SI6. LEVEL 
Pre Post 

9.0 8.8 

3.4 7.1 .05 

5.7 8.3 .05 

4.0 4.0 

.7 3.0 .01 




m 



Shape 

Tdenti fylng 



2.7 3.7 .05 




/O 







i o 



Letters-- 

ReeognUlog 




A 



AO 



Concepts 

Numbers 



5.3 8.4 N.S. 



8,7 16.6 .01 



O 



6 




Concepts-- 

Relatlonal 



12.4 20.4 .01 



Concepts-- 
nn Sensory 



18.8 19.7 N.S. 







Problem Solving 9.7 17.1 



.05 



o 




ft o .s J 




Verbal 

Communication 



O 



4 



/A 








Verbal 

Comprehension 



18.0 34.6 .05 

16.4 21.1 .05 




gure 2 



Range and Means for Pre- and Posttest Responsive Test Scores for 7 Jordan 
children. Blocked In area represents middle 7U of children's scores. 
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For the rest of the subtests, significant changes were shown by the Hurray 
children on all except the Letter Recognition and Sensory Concept tests. On 
these tests, only small non-significant positive changes were shown. The Jordan 
results on these two subtests were stmllor: of )?. possible points on the Letter 

Recognition subtest, the pre-test average was five and increased only three 
points to the posttest average of eight; the average Sensory Concepts score Increased 
only one point between admi nl s tra t Ions . The changes on both tests proved to be 
not significant. 

/ 8oth the Letter Recognition subtest and the Sensory Concepts .one deal with 
concepts not taught by any of the learning episodes presented in the Parent/Child 
Course. Thus, the failure of the children at both sites to show any significant 
change on either of these tests after the Course strongly suggests that the sig- 
nificant changes shown in the rest of the tests for which a test of change was 
appropriate were Indeed due to the child's involvement In the ten week Parent/ 

Child Course . 

DISCUSSION AND CONCLUSIONS 

The results generated by admi n i ste r i ng the Responsive Test before and after 
the Parent/Child Course were very similar at the two sites. Both the Hurray and 
Jordan groups of children had developed color and shape matching skills before 
the Course began. The two groups sheved similar scores on the pre-Course and on 
the post-Course test for each of the subtests; consequently each group demonstrated 
a comparable amount of change between administrations on respective subtests. 

Further, neither group of children made significant gains in two areas not 
reflected in the Parent/Child Course. Children's average scores in each of these 
areas, Letter Recognition and Sensory Concepts, were quite stable over the ten 
week period. These two subtests served as internal controls. That is, if the 
learning that occurred was unrelated to the Course, or If the change in test 
scores was merely a matter of pre-test sensitization, we would expect a change in 
! two subtests comparable with that recored in the other subtests. 
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Such a statement, of course, assumes that the Letter Recognition and 
Sensory Concepts subtests were about as difficult for the children before the 
Course as those for which significant changes were shown* The test data confirm 
the necessary assumption: Letter Recognl tlon. pre-test scores seem comparable to 

the Problem Solving and Verbal Communication scores, while the Sensory Concepts 
pre-test scores are closely parallel to those made on the Verbal Comprehension 
subtest before the course. 

The similarity of all results between the Hurray children and a replicant 
groups of children In the Jordan School District and the failure of both groups 
to show significant change on two subtests unrelated to the Course substantiate 
the conclusions that (1) the children learned a considerable amount over the 
ten weeks of involvement In the Parent/Chlld program and (2) that a large portion 
of what they aid learn over this ten week period can be attributed to the Parent/ 
Child Course Itself, These conclusions need to be re-exami ned wl th larger groups 
of children If possible. We plan to do this In the future at other locations 
where the Parent/Chlld Course will be offered. 
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